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ABSTRACT 

Studies of interpersonal helping processes have 
idenxriied accurate empathic understanding as a skill Significantly 
associated with effective helping. In recent years empathy training 
has become something of a fad, often involving expensive, time 
consuming marathon weekends. In reaction to this trend a 
self-instructional package was designed to teach empathic reponding. 
Results indicate th^t materials were effective in both individual and 
small group versions. Th$re was no difference on judges" rating of 
performance of students taking materials individually or in small 
groups. Students' ratings of performance did not correlate with 
judges* ratings^ (Author) 
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B£ST 



Evaluation of Self-instructional Mini-course on Empathlc Responding 
Robert B. Kozma 

Center for Research t)n I.oarnlnp an<J TeaiijiuK, UnlvcTsfly of MUhlRan 
Uarvey Bert chor 

Schot)! of Social Work, Unlveralty ol MlthlKan 

Studies of in* *rpersonal helping processes have identified accurate 
empathic .understanding as a skill significantly associated with effec- 
tive helping. In recent years empathy training has become something of 
a fad, often involving expensive, time consuming marathon weekends. In 
reaction to this trend a self-ins tructional package was designed to teach 
empathic responding. Results indicate that materials were effective in both 
individual and small group versions. There was no difference on judges' 
rating of performance of students takinp. materials Jiul i v i dua I I y or In small 
groups. Students* ratings of performance did not correlate with iud^(*s* 
ratings. 
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Since Krathwolil's Taxonomy was published in 1964, there has beon . 
much talk about educators' responsibility to include instruction from 
the affective domain in their students' learning. McMurrin (1969.) polni>; 
out that, "The af_fect_ive function of instruction ... is concerned witli 
the disifositions of practical life— motives , passions, the esthetic and 
moral sensitivities, and feelings of concern, appreciation, sympathy, * 
and attachment (p. 8)." 

Perhaps affective learning has no more important a place in learn- 
ing than it does in the training of human service professionals. 
Counselors, social workers, teachers and doctors aie confronted daily 
with a variety of affective situations. Their ability to handle such 
situations appropriately can have a significant impact on their clients' 
lives. 

Studies of interpersonal helping processes sucli as e 1 ienL-cen Lored 
counseling and psychotherapy' have focused on those helpers who have 
achieved highest success rates. In terms of client outcomes (Rogers, 
1957; Rogers, Gin 1 in, Keisler, and Truax, 1967; Truax, 1963; Truax and 
Carkhuff, 1963; Whltohorn and Betz, 1954). A common finding of these 
diverse studies was that accurate empathlc understanding was one of threi- 
central interpersonal skills significantly associated wi Li> effective 
helping (the other two were genuineness and non-possessive warniLli) . 
bergia and Garfield (1971) state th«L, "Accurate emimLhic imd.-rstandi iik 
involves the ability to perceive and communicate accurately and witl> 
sensitivity both the feeling and experiences of another person and their 
meaning and £,ignif icance (p. 317)." 
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In recent years empathy trainJan l*as bocome somethiuR of a fad— 
«)ftc»n involviuM cxpons I vt; , t itui'-coimtiml n^, .i»arat l>oi> w^.H•kl•lld^•. — olton 
nro.sented In a Homewhal nebulous lasliloii .ih In wlial jvu*.! rrspou.H n>', 
looks like. "In reaction to this trend a ae It-instructional package was 
designed as an attempt to effectively teach empathic responding inexpen- 
sively, within a reasonably limited period of time (a one-day mini-course), 
and in a form readily available to interested students. 

■ Tlie mini-course was designed by John Milnes, a graduate social 
work student, in a Special Studies course with Professor Harvey Here 
cher of the University of Michigan's School of Social Work. Some c<" 
the ideas for content grew out of the work of Truax and Carkhuff (1967). 
Skills covered in the materials include: identifying feeJing words, 
selecting synonyms, identifying levels of empathic understanding, dis- 
tinguishiag between thinking statements and feeling statements, creating 
empathic statements, and determining when to use them. 

The course was designed to be "group self-instructional." While 
the instructional information is carried in a booklet accompanied by 
taped examples and does not require the involvement of a faculty member, 
the students participate in group exercises which require the practice 
of newly-learned skills. The group also serves to provide additional 
feedback to its members. The group format was selected for two reasons: 
1) studies on problem solving (Collins and Guetzkow, 196A) and "brain 
storming" (Taylor, Berry and Block, 1958; and Barnlund, 1959) have demon- 
strated that groups are generally superior to individuals in solving 
the same problems; and 2) the group format is a natural mediuin to learn 
and practice a skill used in group settings. 



The final unit is a criterion exercise and requireK each leamer 
to demonsttc.t£ his responding skills in a roleplay situation. Since 
the mini-course was designed to be independent of faculty involvement, 
the members of the group serve to evaluate each others* performances. 
It was hoped that the absence of grades (the coiirst; is offere^as n 
no fe-e-no credit basis) and I nsLnicL-ors , and iUc small group s I w.)iiM 
encourage participat i(ju and ri.sk-Laklng by sLudi-nLs. 
* The booklet and pre-recorded tape that comprise the course's 
instructional materials were first tried with three six-person groups 
of graduate social work students and subsequently revised by Professor 
Bertcher. It is tlTiis revised version that was used in the evaluation 
experiment described in this paper. 

Questions examined during the evaluation of the mini-course were: . 

1. Can empaLhic responding be learned through self-instruction? 

2. Is there an advantage to group interaction during thi' instruc- 
tion? * 

3. Can the learners, provide each other wif.h valid evaluation of ^ 

their learning? 

Design of the experiment . The eighteen gradualfe students from the School 
of Social Work who volunteered for the mini-course were randomly assigned 
to one of three groups: A, B or C. Students in group A went through 
the self-instructional materials as a group of six persons. Bach student 
read the instructional materials privately, then performed the exercises 
and interacted with the other members of the gruup about tiie pi rformaiicc 
of various members. 
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Group B students went through essentially the same materials as 
Group A students except that each learner was in a separate room and 
"was not able to interact with ether students. Students in Group C 
served as a control group and did not receive instruction before taking 
the criterion test. 

The experimental design used in this study is described by Campbell 
and Stanley (1963) as a post-test only-control group design and Is dia- 
graramed as follows: ' \ 

R , X • 0 

A ■ 

R X 0 

B 

R 0 

Where K stands for randomized assignment to treatment groups, X Lands 
for materials taken as a group (Group A), stands for mater taken 
individually,, and, 0 stands for the criterion measure. 

The basic differences between materials received by students in 
Group A and Group B are: 1) directions referred to grcaips in one case 
and individuals in the other; and 2) the comments and feedback provided 
by member interaction in Group A was not ax/ailable In Croup li. An i-x.ini- 
ple of both, types of differences is this set of passages taken from Liir 
booklets: 

(Group A) The next five statements are prefaced by the phrase, 
•'You seem to feel*^/* However, some are actually thinking state- 
ments. Privately place a check next to those that are thinking 
rather than feeling statements. After having read all five state- 
ments, and checked as instrupeed above, work to achieve group con- 
sensus on the scoring of-e^h statement. (Statements and -correct 
answers given) ♦ 

(Group B) The ^next five statements are prefaceti by the phrase, 
"You seem to feel../' Hoi:ever, some are actually thin king state- 
ments. . Place a check next to those that are thlnjdLn_g rather than 
feeling statements. (Statements and correct answers given). 



Instructional content was. identical for both groups, and any "outside 
information" was limited by restricting participation to those students 
who had had no previous training in cmpathic responding. 

Evaluation procedures — the criterion exercise . Dir. ^rons for the cri- 
terion exercises were identical for all group.s» Ujv.. completion of the 
instructional materials, for Groups A and IJ^ and without instruction 
for Group C, the students formed triads for the exerv^ise. 

During the exercise one student took the role of speaker (or client), 
ant»ther took the role of listener (or counselor) , and the third was an 
observer. During the roleplay (which was .limited to five minutes) the 
speaker recalled a problem situation from personal experience and thu 
listener responded . eropathically when he considered It appropriate. The 
observer listened in so that he could give the listener feedback on his 
performance (although the feedback was not given until the criterion 
exercise was completed). Roles were then rotated and the exercise was 
repeated with a new problem situation. The exercise continued until 
each student performed the criterion role of listener. 

Upon completion of each roleplay the listener was rfited by each 
triad aiember (including himself) on his accurateness of empathy, timing 
of response, response form and on a summary rating. Accuracy and timing 
were rated on a five-category scale as to liow often the listener pc-r- 
formed properly for each factor^ Form was a combination of tliree five- 
category ratings on sub-items of: use of synonym, use of tentative 
statement and relating feeling to situation. The summary rating was 
1 to 5 good-bad semantic differential. When the students were finished 
with the criterion exercise, each rated the course on a five-point scale. 
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Separate tape recordings of each roleplay wero made to be used by 
the faculty judges. ' Three faculty judges, two social work faculty mem- 
bers and one of the researchers were involved in prior discussions on 
evaluating empathic responding in order to increase inter-rater relia- 
bility T Each judge listened to the recordings and independently rated 
the speaker using the same "instrument used by the sludents. Althougli 
the judges were familiar with the iuHtrucLional inaH-rlaJs and Llic cxp.-r- 
imental design, they listened to the tape recordings in a random and ^ 
unidentified order. . . 

The criterion exercise was a compromise between rigor and pragma- 
tism. The fact that each speaker created a unique problem example in- 
troduced an undesirable element of .error variance in the criterion 
situation. A more uniform situation would have been to use actors as 
speakers and a standard problem situation. However, since the criterion 
exercise was as mu'ch a test of the ability of tlie students to control 
the evaluation as to test the ef f ect I vcnes:? ol tlu- maiorlals I lu- crlu-r- 
ion situation, described o:bove was selected. it w.js assuim-d lli-il tin- 
"quality" of the problem situation was random across groups. This as- 
sumption was tested by having judges rate each of Che problem examples 
on five-point scale, as to the amount and variety of feeling expressed. 
Comparison of ratings adross groups showed no differences. 

A second methodological concern in the evaluation was a possible 
"teaching effect" occurring as the exercise progressed. That is, lis- 
teners involved in second or third-round roleplays may have acquired 
skills from observing previous rounds. Again, a compcrlson of judgi-s' 
ratings across rounds showed no such effect. 
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Table 1 

* 

Separate -and Combined Judges' Rating: 
Descriptive Data and Inter-Rater 
Reliability Coefficents. 



Judge A ■ ' ^ 
Accuracy 
Timing 
Form 
Summary 

Judge B v 

Accuracy 
^ Timing 
FoYto 
Summary 

Judge C 

Accuracy 
Timing 
Form 
Summary 

Combined 
<J Accuracy 
Timing 
Form 
Summary 



N 



^ ft- 



Mln 



Inter-raUer 
.Max Reliability 



17 


2.53 


1.12 


1 


5 




17 


2.47 


1. 37 


1 


c 

5 




17 


7.53 


3.41 


J 


ID 




17 


2.82 


1.47 


1 


5 




i7 


'2.82 


0.81 


2 


A 




17 


2.41 


1.06 


1 


5 




17 


8.06 


2.79 


5 


15 " 




17 


2.82 


1.3S 


. 1 


5 




17 


2.35 


1.06 


1 


5 




17 


2. 35 


0.93 


1 


4 




17 


6.94 


2.75 


3 


12 




17 


2.41 


. 1.23 


1 


■ 5, 




17 


7. 70 


2.44 


4 


12 


.87 


17 


7.24 


2.84 . 


4 


12 


.85 


17 


22.71 


8.16 


11 


38 


.88 


17 


8.06 


3.45 


4 


14 


.88 



Table 2 

Comparison ol C(^)rabined Judge Ratings 
BetWeen Groups 



Comparison 







*1 


Y 


1 




DF 


T 


Group A: Group 


C 












-4.28*** 


Accuiracy 




6.17 


10.40 


3.37 


1.80 


. 9 


Timing 




5. 33 


10.80 


2.27 




9 


-7.20**** 


Form 




18.33 


31. 80 


19.07 


19.70 


9 


-5.05**** 


Summary - 




5.67 


12.00 


3.47 


3. 50 


9 


-5.60**** 


Group B: Group 


C 




< 








-3.35** 


Accuracy 




7.00 


10.40 


3.60 


1.80 


9 


Timing 




6.17 


10.80 


4.57 


. 70 


9 


-4.53*** 


Form 




19.00 


31.80 


25.60 


19. 70 


9 


-4.41*** 


Summary 




7.17 


12.00 


8.57 


3.50 


9 


-3. 18* 


Group A: Group 


B 












-0.77 


Accuracy 




^. 17 


7.00 


3.37 


3.60 


10 


Timing 




5. 33 


6.17 


2.27 


4.57 


10 


-0.78 


Form 




18.33 


25.60 


19.07 


25.60 


10 


-0.78 


Summary 




5.67 


7.17 


3.47 


8.57 


10 


-1.06 



* .05 

** .01 

*** .005 

**** .001 



+ test of difference in ^variance significant beyond .05 
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ResuJ._L8 Sf 
/ Meaua and stand.ird dcvialUms of sfjiaralv and romlilaod ratlnn:^ <»r 

judgeh on accuracy, timing, form and sununary rntliij-s are displayed in 
Table X. Also shown is the combined correlation coefficient for judge 
inter-rater reliability for each measure. Because of equipment malfunc- 
tion, one roleplay was not recorded, thereby reducing the N of judges' 
ratings to 17. 

.. ■ Combined ratings were treated as interval data and t-tes^s were 

V used to compare each group on each measure. Question 1 concerned the 
possibility of learning empathic responding through self-instruction.' 
Table 2 shows that both the small group (Group A) and the Individual ^ 
students (Group li) performed significantly bettor on all measures tlian 
the control group (Group G) . » 

With regard to Question 2. a lack of significant differences "between 
Group A and Group B would indicate no apparent advantage of smalL group 
instruction over individual instruction. Nor did differences between 
these groups appear in subjective student ratings of the mini-course ^ 
as indicated in Table 



Table 3 

o . 

Comparison of Student Course Ratings Between Gro up A and Group B ^ 



Comparison 



Group A: Group B 
course fating 



.^2 



S2 ^ DF 



'1 ."2 -^1 

2A7 2.67- 0.17 0.'27 . 10 -1.86 
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Table 4 --^ 

r 

Separate and C()nil>ined StudiMU 
Ratings: DIscrlptlve and lulir- 
Kel lability Coefficients 



N 



SD 



Min Max 



Inter-Rater 
Reliability 



Listener 

Accuracy 
Timing 
Form 
Summary 



18 


2.39 


0.70 


2 


4 


18 


2.44 


0.5] 


2 


3 


18 


6.78 


1.31 


4 


9 


18 


2.28 


0.75 


1 


4 



Speaker 

Accuracy 
riming 

.Summary 

Combined 

Accuracy 
Timing 
Form 
Summary 



18 


2. LI 


0.68 


1 


3 




18- 


2.06 


0.54 


1 


3 




18 


6.89 


1.23 


4 


9 




18 


l.'J4 


0.64 


1 


3 




18 


4.50 


l.IO 


» 3 


7 


. /« 


18 


4.50 


0.71 


3 


6 


.62 


18 


13.67 


1.26 


11 


17 


.56 


18 


4.22 


1.26 


2 


7 


.91 
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Student ratings were also collected on all measures for each role- 
play. For each listener ratings were collected from the speak.i:r and 

the listener (sell ratings); however, due to a confusion of directions, 

c 

incomplete data was collected from s.tudonts in the role of observer. 
Student evaluation analysis was limited to ratings from the speaker and 
the listener. Student ratings and inter-rater reliability coefficients 
were quit.2 high as shown in Table^A. 

Question 3 was concerned with the ability. of students i^o rate thuin- 
selves and each other. This was answered by comparing student, individual 
and combined ratings with judges' combined ratings for each factor. 
Correlation coefficients are displayed for each criterion measure in 
Table 5. None of the correlations are significant. 

Table 5 

Correlation Coefficients for Judge and 





Separate 


and Combined 


Student 


Rat in^s _ 










Accuracy 


IJjnin£_ 


Fo rm 


Summary 


■Judges : 


li stener 


.14 


' -.04 


.00 


-.01 


Judges : 


speaker 


.24 


-.29 


.26 


.2 '4 


Judf^es : 


combined 


.24 


-.25 


.n 


.12 



D iscussion . . Results indicate that the mini-course was very effective 
in both the individual and group versions. Highly significant differ- 
ences on all measures attest to the ability of a sel f -instruct ional 
package to teach affective skills. Such results stiould encourage Qther 
educators to develop and test materials in other affective areas of 
human .service professional training. 



The fact that there were no differences betv>7een small group and 
individual pertormafece and the fact that boti) forms were successful ^^ug- 
gests no advantage of one versioA over the other* However, criteria 
other than student performance may suggest various advantages and dis- 
advantages. Administratively, the individual version may obviate 
students waiting. for groups; to form (assuming that the criterion exer- 
cise can be individualized). On the other hand, some students may- pre- 
fer the company and interaction of others during their learning. The 
availability of both versions would provide the student and/or admini- 
strator with either option. 

The lack of correlation between judge ratings and student ratings 
appears to be due to the inabi^l^ity or unwillingness of students to be 
discriminating in their evaluations. Table 4 shows small standard de- 
viations and narrow ranges in ratings. This situation create.q two 
difficulties: 1) If the course were to be offered for credit^ student 

evaluation could not be used for grades; and more importantly 2) lack 

•J 

of discriminating feedback neither reinforces good performance nor as- 
sists the learner in correcting poor performance. 

One measure to offset the students* poor evaluation performance 
would be to return the evaluation function to the faculty member. How- 
ever, the researchers suggest, a bet ter^ approach would hv both l<> train 
for and encourage more discrimination in student fe.edba^lk. /\n additional 
unit could be included in the package which would teach students to 
identify taped examples of good and bad empathic rt^sponding. Further 
explanation of the instructional values of discriminating feedback may 
assist students in overcoming any reluctance they may have of being 
''too judgemental" of their peers. 
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